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ABSTRACT 

The equivalency of item sampling and student 
sampling of attitudes of college students was investigated* A factor 
analysis of s tuder t -sa mpled data collected daring Spring 1968, was 
compared with a factor analysis of item-sampled data collected each 
quarter from Fall 1968, through Winter 1970, at Mankato State 
College, using the Campus Environment Study (CES) developed by the 
Central States Colleges and Universities Cooperative Research 
Program* In an earlier study item sampling was demonstrated to be 
equivalent to student campling in terms of correlations of item means 
and standard deviations. It was also found that standard deviations 
of item-sampled responses were systematically smaller than for 
student sampling. When the results of that earlier study and the 
present one were compared, factor structures of student attitudes 
were found to be similar if not equivalent* Factors from item 
sampling had several common items on similar factors gained from 
student sampling. Item- sa rip led factors contained many items from the 
same a priori environments of the original item pool. The congruence 
of the items in the item-sampled factors was judged to be high, with 
some notable exceptions which could be attributed to the less than 
perfect intercorrelation matrix. An example of a typical item Simple, 
consisting of six questions taken from the full 150-item CES j.s 
attached. (Au t hor/TA) 
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I M TRO D y 0 r . n I 0" x ! 

Serious questions have beer: raised about the strength 
and flex.ibi.lity or our educational system. John Gardner has 
r.po?:er. el unloving critics , uncritical, lever.: and loving 
critics . Too many opportunities have been provided the un- 
loving critics end uncritical lovers within and without our 
institutions of higher education. Few, if any, provisions 
have been made for the development of loving critics. Yet,, 
if our institutions are to retain or gain strength, they 
must have the flexibility to respond to responsible input 
from the majority of: patrons. Historically when students 
were allowed to engage in criticism, a sample of students 
v/as ashed a population of questions. After receiving poor 
returns with limited opportunity for collecting responses 
regular Jy over l\ period of years, it has been decided there 
must be a better way* 

Item sampling involves randomly selecting items rather 
than individuals and then administering the item samples to 
a population instead of with a sample of individuals. Item 
sampling has the potentiality of providing a voice for the 
silent majority. Lord (3.2 55, 3 960, 196X) laid he groundwork 
a n d demon s t r a t o d the prac 1 i c: ab i 1 i ty of it cm s m . p ] i n g for 
achievement testing applications. Lord (3562), Plumlee ( 1 S' C d } r 
and Cool f, Stuf f leboam (1967) extended research on item sanu- 
pling by using various sine iter, samples and examinee samples. 
This study, ns well an an empirical comparison of t.ho validity 
of if-un and examinee sampling (Ov;ena a Stuffloboam, 1967), 
indicated that a largo lumber of examinees taking only a few 
.1 1 r.r-.is c: a eh p i o v i d r • d a b o t for cut \ m =! 1 e of t h a p op u 1 at ion no >; m 
thar r. m~l? »■> g p^or* r> v i p ^ j te^ic.* p ? 1 xb. 

Sax & Cromach (1966) and French & Greer (1964) have addressed 
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the context question and demonstrated that if the time limit 
is generous and the sample is short, context or the order of 
the items fades as a determinant of responses to the items. 

As Lord suggested in 1962, item sampling is being used to 
trade items for people in a wide variety of situations. It 
is being used in National Assessment (Merwin & Womer, 1969) , 
achievement monitoring (Allen & Hackin', 19 70) and in the U. S. 
census . 



It is the purpose of this paper to investigate the equiva- 
lency of item sampling and student sampling of the structure 
of attitudes of college students. If we are to provide oppor- 
tunities for the masses to respond to the concerns of higher 
education, we must provide a simple straight forward means of 
evaluating attitudes of our patrons. At a general session of 
the 1970 A.E.R.A. convention on problems and developments in 
research design and methodology in studying the college stu- 
dent, Howard Becker pointed out that the day of getting returns 
on 150 -item inventories from college students is past. Alexander 
W. Astin suggested that C. Robert Pace and others were so con- 
cerned with reliability in the development of college environment 
scales when they utilized the acrcc/disagree response pattern 
(Pace t Stern, i.958) that they did not allow for measurement of 
change. It is unlikely that, in a. short period of time, n 
student's response will shift abruptly from agree to disagree, 
but very possible that he might move from strongly agree to 
agree or uncertain on a five point scale. 

To achieve this purpose illustrative data from a "Campus 
Environment Study* 1 will be presented. Factors from a factor 
analysis of item Sctmpies will be analyzed from the standpoint 
of the following questions: (I) Are the factors from item*- 

sampled data similar to factors of student sampled data? 

(2) Are the item-sampled factors representative of items in 
a priori environments? (3) Are tho items in the item-sampled 
factors congruent? 



METHOD 



Items from the Campus Environment Study (CBS)* wore item 
sampled and administered to students at pre-regis tration each 
quarter starting in Fall, 1960. Each item- samp! o contained 
six statements which were randomly selected from 150 items. 
During the academic year 1960-69 a stratified x anclom sample 
was drawn, one item from each of six a prior 1 collage environ- 
ments: Academic, Physical, Cultural, Communications, Community 

*Thc writers wish to express appreciation to Dr. Herb Si Ivey 
of Central States College and University Cooperative Research 
Program for permission to utilize the pool of items from the 
Campus Environment Study. 
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Relationshi.ps and Moral-Ethical environments. During Fall, 

19 69, and Winter, 19 70, the .six items were drawn completely 
at random from the pool of items, (See Appendix A) At 
Mankato State College there were 5,958 item samples collected 
during Fall, 1968? 5,421 during Winter, 1969; 4,174 during 
Spring, 1969? 7,454 during Fall, 1969? and 7,690 during Winter, 
1970 for a total of 25,276 representing over a 93 perccnc 
return from those pre-registering. A missing data correlation 
matrix program was developed by the co-author at the University 
of Minnesota. This "psuedo" matrix “was then applied to a prin- 
cipal factor analysis and the factors rotated to> meaningful 
structure with a varimax rotation program. Due to the "psuedo" 
matrix, a .40 rather than a .35 factor loading was used as a 
cutoff point. The factors thus obtained were compared with 
factors similarly obtained from a student sampled factor analy- 
sis bas'ed on data collected on all 150 items from 791 students 
at Mankato State College during Spring, 1968. (Petersen, 1969) 
The factors were also compared with the a p riori scales of the 
CDS and the congruence of items on each factor was interpreted. 



RESULTS 



Item sampling was demonstrated to be equivalent to student 
sampling in terms of correlations of item means and standard 
deviations in a previous study. (Petersen, 1969) It was also 
found that standard deviations of item-sampled responses were 
systematically smaller than for student sampling. 

In the present study the "psuedo" correlation matrix, 
which was a result of intercorrelations of 25,276 six item 
samples, produced some factor loadings greater than unity. 
However, a previous factor analysis based on 15,144 item sam- 
ples produced some factor loadings as grecit as; 1.38, 1.17, 1.34 , 
1.25, 1.29 and 3.18. The high factor loadings in the present 
study such as 1.03, 1.08, 1.07, 1.10, 1.04, i.07 and 1.18 are 
more tolerable but indicate a need for still more data. If 
the data collected in 1960-69 had not been based on stratified 
random sampling it is likely that fetter factor loadings would 
have exceeded unity. 

In the tables which follow, the factors will be presented 
and the three questions relating to the purpose of the paper 
addressed for each factor. On the right of each table the 
factor number derived from the student sample factor analysis 
is listed. While this docs not allow for a direct comparison 
of factor structures derived from student sampling and item 
sampling, it is all that can he accomplished at this tine. 

The factors from the student sampled data are number I-X and 
the factors from the present study are number XI. -XX I. 

Factor XI in Table 1 is similar to Factors I and IV of the 
student saitpled data. Factor I was a dimension involving warm 
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personal communications between and among students and faculty. 

Factor IV involved official, administrative type communication. 

The item sampled factor XI is a combination of the student 
sampled factors and four of the five items are from the a priori 
communications environment (items 76-100) . The congruence of 
this factor is very high with all of the items dealing with 
concern and communication. 

TABLE 1, Factor XI from Varimax Rotation Loadings of Principal 
Factor Analysis of the 150 Items of the Campus Environment 
Study at Mankato State College, ^Fall , 1968, through Winter, 1970 

Item No. Item Factor Student 

Loading Sampling 
Factors 



9 3 


The admin J s tration attempts to keep stu- 
dents informed on matters of policy. 


1.03 


IV 


9$ 


The administration informs faculty and 
students promptly of col icy changes. 


. y 0 


IV 


9 4 


There is a friendly relationship between 
faculty and. students. 


.72 


1 


79 


Generally, students feci quite comfortable 
in approaching instructors regarding a 
problem. 


.<17 


I 


107 


The faculty on this campus is consider cite 
ar.d concerned v?ith student problems. 


, <' 


I 



Factor XII is not similar to any of the student sampled 
factors except that it 5s made up of items from three different 
factors . Two of the three items arc from the communications 
environment of the a priori scale and are ?ongruent, All three 
items do not appcar~to have congruence with one another unless 
drinking habits can be related to communication • 

TABLE 2, Factor XII from Varimax Rotation Loadings of Principal 
Factor Analysis of the 150 Items of the Campus Environment 
Study at Mankato State College, Fall, 1968, through Winter, 1970 



Item 


No. Item 


Factor 

Loading 


Student 

Sampling 

Factors 


83. 


The administration and teaching faculty 
appear to cooperate well . 


1.08 


TV 


12 7 


Excessive drinking by students dees not 
create a real problem on this campus. 


.61 


II 


70 


It is easy for students Lo communicate 
wi th the administration , 


.44 


I 
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Factor XIII has one item in common with factor VIII 
which was an organizational communications factor. The other 
two items are from the a prio ri physical environment. Two 
of the three items are congruent but the third is not. 



TABLE 3. Factor XIII from Varimax Rotation Loadings of Principal 
Factor Analysis of the 150 Items of the Campus Environment 
Study at Mankato State College, Fall, 1968, through VJinter, 1970 



Item 


No. 




Item 


Factor 

Loading 


Student 

Sampling 

Factors 


34 


The library 


is 


a good place to study. 


3.07 




31 


The campus 
appearance . 


has 


a very attractive 


. 71 




88 


The student government is functioning 
satisfactorily . 


. 4S 


VT I V 



Factor XIV in Table 4 did not load on Idle student sampled 
factor analysis. All items are fiom the a priori academic 
environment. The items are exceptionally congruent, have high 
loadings and relate to good teaching. 

TABLE 4. Factor XIV from Varimax Rotation Loadings of Principal 
Factor /inalysis of the 150 Items of the Campus Environment 
Study at Mankato State College, Fall, I960, through Winter, 1970 



Item No. 



Item 



Factor 

Loading 



21 Good teaching i s a characteristic of most 3. .10 

instructors at this institution. 

18 Most instructors recognize a superior student .66 

and arc willing to take ex tret time to challenge 

hira. 

19 There is a good balance between idealism ancl .65 

other points of viev/ in the classroom. 

4 Stimulating classroom discussions arc frequent. .04 



Factor XV in Table 5 did not load on the. student sampled 
factor analyses. All items arc from the a priori academic 
environment. The items are congruent and indicate th.it this 
may bo a scholarship dimension of the academic environment. 
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TABLE 5. Factor XV from Varimax Rotation Loadings of Principal 
Factor Analysis of the 150 Items of the Campus Environment: 

Study at Mankato State College , Fall, 1963, through Winter, 1970 



Item No. Item Factor 

Loading 



6 High scholarship is a common goal of most 1.04 

students . 

11 Examinations satisfactorily measure course .56 

assignments and presentations. 

8 Many students on this campus are striving for .55 

high grades . 

13 The academrc atrnospnere on LL i s campus encourages • 5«d 
students to go on to graduate work. 



Factor XVI is yet another academic factor which did not 
load on the student sample analysis. All five items arc from 
the a priori academic environment. Most items are congruent 
and relate to dedicated Leaching . 

TABLE 6. Factor XVI from Varimax Rotation Loadings of Principal 
Factor Analysis of the 150 Items of the Campus Environment 
Study at Mankato State College, Fall, 1968, through Winter, 1970 



3:tera No. Item Factor 

Loading 



12 Most instructors here are dedicated teachers. 1.07 

13 The academic atmosphere on this campus encourages .56 
students to go on to graduate work. 

2 Most instructors are very thorough in the teaching .50 
of their subject matter. 

IS There is a good balance between idealism and other .43 
points of view in the classroom. 

24 The institution provides a great many academic .42 

resources for student use. 



Factor XVII in Table 7 seems to be a community related 
physical environment dimension. The four items which loaded 
on the student sampled factor analysis each came from i 
different factor. Three items come from the a priori commun- 
ity relations environment (items 101-125), two from the 
physical environment, one Ccach from the a ))>:Jori cultural and 
communications environment. Despite the diversity, the items 
seem congruent in the community related physical area. 
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TAQLE 7. Factor XVII from Varimax Rotation Loadings of Principal 
Factor Analysis of the 150 Items of the Campus Environment 
Study at Ilankato State College, Fall, 1968, through Winter, 1970 



Item No. 


Item 


Factor 


Student 






Loading 


Sampling 

Factors 



36 


Off-campus housing facilities are 
satisfactory. 


.92 


95 


Rumors are quickly disspelled on 
campus by ready access to facts. 


this 


.66 


109 


The merchants in this community 
dents like first class citizens. 


treat stu- 


. 62 


54 


Classical music is popular with 
of students . 


tha majority 


. 54 


47 


Pious in g costs are reasonable for 
ities and services provided. 


the facil- 


. 51 


117 


Upper classmen provide helpful leadership 
to new students. 


.4? 


1C 5 


The general atmosphere on campus 


is friendly. 


-.67 



IV 



VII 



V 



Factor XVI. XI relates favorably with factor II of the student 
sampled analysis. That factor was a large moral -ethical factor. 

The items arc very representative of the a pr iori moral-ethical 
environment (items 126-150) . The items on thi s factor are partic- 
ularly congruent in the moral ethical dimension. 

TABLE 8. Factor XVI I J from Varimax Rotation Loadings of Principal 
Facto?: Analysis of the 150 Items of the Campus Environment 
Study at Mankato State College, Fall, 1968, through Winter, 1970 



Item No. Item Factor Student 

Loading S amp ling 
Factors 



O 

ERIC 



1 3 B 
126 
111 



136 

74 



Uncontrolled student behavior is not a 
characteristic of this institution. 


.98 




Students respect institutional rules and 
regulations . 


.74 


II 


There are ample opportunities to meet 
people through social functions and student 
organizations . 


. 61 




Institutional regulations do not place 
unrh'o restraint's on social conduct. 


. 40 


V 


In general the speech and habits of students 
reflect refinement and yood taste. 


.40 


II 


Excessive drinking by students does create 
a real problem on this car., pus . 


.40 


II 



7 



127 



- 8 ~ 



Factor XIX in table 9 docs not relate to the student 
sampled analysis, although one item appeared on each of 
factors I and X. It does not relate veil to any of the 
a priori environments except perhaps the moral-ethical domain. 

The congruence of the items relates to freedom of expression 
and openness for the most part but items on the use of drugs, 
library assistance and preparation for* classes contradicts 
this interpretation. 

TABLE 9. Factor XIX from Varimax Rotation Loadings of Principal 
Factor Analysis of the 150 Items of the Campus Environment 
Study at Mankato State College, Fall, 1968 through Winter, 1970 



Item N T o. Item Factor Student 

• ' Loading Sampling 

Factors 



7 


Open mindedness and objectivity are * - 

characteristic of most classes. 


■1.00 


77 


The expression of student opinions is 

e i 1 CO Ul aCjCU • 


. 49 I 


14 7 


The use of hallucinatory drugs K y students 
has not become widespread on this campus . 


. 49 


42 


The library staff provides sufficient 
personal assistance in locating materials 
in the library. 


. 4 5 


130 


Freedom of speech is an accepted practice 
on this campus. 


.40 


9 


Considerable out-of -class preparation by 
students is necessary for most courses. 


.40 ): 



Factor XX related veil with factors I and III of the 
student sampled analysis. Factor 1 was the warm personal 
communications factor arid III a friendliness dimension. 
Three of the four items are from the community relationship 
environment of the a pri ori scale (items 101-125) . The 
congruence of this factor relates to mutual respect and 
concern between and among students and faculty. 
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TABLE 10. Factor XX from Varimax Rotation Loadings of Principal 
Factor Analysis of the 150 Items of the Campus Environment 
Study at Mankato State College, Fall, 1968, through Winter , 1970 



Item No. Item * Factor Student 

Loading Sampling 
Factors 



122 


The faculty, as a general rule,* welcome 
student appeal for advice and counsel . 


1.18 


I 


110 


There is a feeling of mutual respect 
between students and faculty. 


.54 


I 


112 


Students show a concern for each other 
at this institution. 


.50 


III 


7 8 


Instructors are easv to approach with 
questions concerning classwork. 


.49 


I 



Factor XXI does not relate to any of the student sampled 
factors- except factor VII which v;hilc they have only one item 
in common seem both to be measuring student cultural opportunities. 
Seven of the eight items are from the a priori cultural environ- 
ment {items :>1~7 5) . The congruence of this factor is exceptionally 
high and all. of the items arc related to cultural opportunities 
including recreation . 

TABLE 11, Factor XXI from Varimax Rotation Loadings of Principal 
Factor Analysis of the 150 Items of the Campus Environment 
Study at Mankato State ColJeae, Fall, I960, through Winter, 19 7 C 



Item No. Item . Factor Student 

Loading Sampling 
Factors 



O 

ERIC 



59 Dramatic presentations are given frequently ,£9 
on campus. 

29 Recreational facilities arc adequate to meet .*0 
the needs of most students. 

75 Artists and performing groups appear .45 

frequently on campus. 

70 The library of tapes and records , i.c., music, . / ~ 
poetry, etc., is used extensively by students. 

64 Ihere is opportunity to study cultures other .42 
than our own . 

51 Opportunities are provided for students to .40 

evaluate works of art. 



65 There are a variety of performing musical 
groups on this campus . 

56 five performances of symphonies, ballot, and 
eper n s a r a we 1 1 p o t i ■ c > i i y c.d b y the stud o n t s , 



- . 51 
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All six of the a_ pjoioigi environments were represented 
in both factor analytical studies. As can be seen in Table 
12, there wera two more academically oriented factors among 
the student sampled factors. The academic factors were all 
small being comprised of five or fewer items. The communi- 
cations environment split four ways in the student sampled 
analysis with a student newspaper and organizational commun- 
ications failing to appear on the item sampled analysis. The 
othor difference in number of factors was in the community 
relationships, environment where two ‘factors were identified 
with relatively few items which although in a majority on 
the factors, were from this environment. 

TABLE 12. Number of Factors Gained in A Priori Environments 
from Varimax Rotations of Principal Factor Analyses of ' 
a Student Sample of Spring, 1968 and Item Sample.- of 
the 150 Items of the Campus Environment Study at Mankato 
State College, Fall, 1968 through Winter, 1970 



Environment 


Item Sample 


Student Sample 


Academic 


3 


i 


Physical- 


1 


. 1 . 


Cultural 


2 


2 


C omrou n 5. ca t i o n s 


2 


4 


Community Relationships 


2 


1 


Moral Ethical 


1 


7 


TOTAL 


11 


10 



DISCUSSION 

The present results indicate that the structure of student 
attitudes are similar if not equivalent v;hen measured v/5 th item 
sampling and student sampling. The student sample factor analysis 
was completed using Spring, 1960 data and the item sample analysis 
utilized date collected each quarter from Fall , 1968 through Winter, 
1970. It is impossible to collect sufficient item sampled data 
on one medium sized campus during one quarter unless the population 
of items is reduced or the item sample size is .\ncr eased. 

Even with these limitations in the present study, several 
items load or similar factors. The item sampled factors load 
more consistently on items from the same a prieri environments 
despite the i act that the contiguity or order c:: items is at 
random. The congruence of items loading on the same item sampled 
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factor is similar to student sampled factors with some 
notable exceptions. The exceptions may be related to the 
"psuedo" intercorrelation matrix but then the similarity — * * 

also may be associated with the less than perfect matrix. 

By utilizing a .40 factor loading cutoff for inclusion in 
a factor this limitation was compensated for in part. 

All of the a prio ri environments were represented in 
both factor analytical studies. There were two more acad- 
emically oriented and two fewer communications oriented 
factors in the item sampled analyses than in the student 
sampled analysis. This difference may be accounted for by 
the temporal difference in when the data was collected. It 
may also be attributed to the factor analytical process itself. 

The present study should be considered a pilot study or 
at most a developmental attempt to equate student sampling 
with item sampling. More research is needed. A proposed 
next step in the development of item sampling may a]. so prove 
to be more conclusive. That would be to administer one com- 
plete 150 item inventory to a student sample for every 25 six 
item samples of the pool of items at the same time on several 
college campuses or at one large university. This would be 
superior to decreasing the population of items because one 
assumption of: item sampling is that the items must represent 
all items which could be asked. It would also be superior 
to increasing the item sample size because six items is most 
optimum for fitting on one page and producing a very high 
rate of return. 

In summary, factor structures of student cittitudes v/ere 
found to be similar if not equivalent. Factors from item 
sampling had several common items on similar factors gained 
from student sampling. Item sampled factors contained many 
items from the same a pri o ri environments of the original 
item pool. The congruence of the items in the item sampled 
factors was judged to be high with some notable exceptions. 
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DO YOU HAVF FOUR MiMJ'ifs fO V : F L ?' U? I rHf v' liC'OO* 

Hr. re is ycuT oppo lenity !.i rov;:^. ~ >J *■■. -,i« d ••-'• s z * ■« ? -‘.1 - , i< , . ■ ■ ■ ■■ 
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